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Research suggests that when subjects are given a rule 
as to how to translate auditory or verbal information into images, 
the images have many common characteristics with cognitive 
representations derived from visual perceptions. This experiment 
examined the process of cognitive integration and the similarities 
and differences between how imagined and perceived information is 
processed in solving problems. The information integrated consisted 
of straight lines and semi-circles. All subjects learned to identify 
lines or curves corresponding to one of eight numbers "through a 
paired-associfite procedure. In the integration phase, subjects had to 
mentally construct one or more letters from 26 subsets of three 
^itlm^nt-lin^a previously learned. Lines were presented to different 
subject groups by two methods, display or imagery. Unlike similar 
research, subjects could use different strategies: work forward from 
lines to letters, or backward from letters to lines. Results showed 
that different stimulus information sources can produce different 
situational and cognitive demands. These factors can affect the 
subject's choice of problem solving strategies and produce different 
response patterns. This research illustrated that methods are needed 
for perception and imagination research which do not restrict 
subjects' processing strategies. (BS) 
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The effects of inaQinlng and perceiving 
on prc^ 1 solving strategies; 

Gerard Hanley and H. William Horrison 
State University of New York at Stony Brook 

In the process ' of accunulating evidence for wental 
imagery , some researchers (Peterson^ Holsten , & Spevak, 
1975; Peterson^ Thomas^ 6 Johnson^ 1977) have exploited 
people's ability to deliberately integrate separate bits of 
information into images. 

^. ' ■ / 

Insert Figure 1 about ht:re. 



The |;^pical Dit^thodology involved having subjects imagine a 
matrix and listen to a sequence of signals. One of the tvo 
alternative signals would indicate that ^ cell in an 
imaginary matrix should be filled in and the other 
alternative indicated an unfilled cell. The subjects were 
also given a lule to translate the signals into the cells of 
a matrix. The top section of Figure 1 £>hows an t^xample of a 
matrix and such a rule: the first signal corresponded to 
the top, light corner cell, the second signal corresponded 
to the top, right-middle cell^ etc.. 

After the sequence of sounds was presented # the 
subjects were asked to identify the letter in the alphabet 
repres^-^nted within the imagined matrix. Peterson, Holsten^ 
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B Spevak {197[>) have shown that Bioie than 90% of the tiine^ 
subjects were able to transform the auditory signals into 
their corresponding visual coaponents and integrate thew 
into an identifiable letter • Peterson et. al« (197b) also 
found that subjects were able to identify letters rotated 
f row the upright position ecjually well • Murphy and 
Hutchinson (1982) also used a very similar methodology; 
they instructed subjects to translate a series of verbal 
descriptions into an inage^ They demonstrated that the 
visual complexity of the constructed image had a substantial 
effect on subjects • abilities to recall the imagined 
pattern. 

The data suggests that when subjects are given a rule 

I 

as to how to translate auditory or verbal information into 
images, the images have many common characteristics with 
cognitive representations derived from visual perceptions* 
From these and similar experiments (Copper and Sliepard, 
1973; I'inke, 1980)^ Shepardand Podgorny (197B) have 
hypothesized that the cognitive processing of images and the 
perceptual procesring of visual stimuli involve many of the 
same component processes which in turn produce similar 
respoDse patterns in imagery and perceptual tasks. 

The [)iesent experiment further examined the process of 
cognitive integrotion and the similarities and differences 
between how imagined and perceived inlormation is processed 
in solving proMeint. The information integrated consisted 
of straight lines and semi-circles (see bottom of Figure 1) • 
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The study wan conducted in two i)artH: the Phired-^associate 
leariiincj phase and the. I uteg ration, phase. 

r 

Method 

PAL phase : All tul>je<^ts were run individually and each 
learned to identify the line or curve that corresponded to 
one of the eiyht nuiibers through a pciired-associate 
procedure. The bottoni of th,e slide shows the eiyht pairs of 
lines aiiti numbers. When the subject was yiven a number^ 
s/he had to identify the corresponding line fr^dni a set of 
tour dis tractors 

iHliiSiililiSIl After learniny to; associate the 

lines with the numbers^ all subjects were instructed that 
the lines viewed durinn the first part of the experiment 
were actually elements of upriyht, capital letters in the 
Enfjlish ali'habet. Tiom a subset of three diflerent lines^ 
the subject had to i»entally coiubine these lines in different 
ways to constluct one or ifiore letters. When one or more 
letters could be constructed^ the subject said the letters 
aloud ^ They were yiven one minute to generate as many 
letters as they could. There were twenty-six letter- 
conf tiucti c»n trials, all subjects wer'^ presented with the 
sanit*, randcin) sequence of trials, and no feedback about the 
correctness or incor roctner>s of the subjects' responses was 
<j iven • 

There wc»ie two methods of presenting lines to be 
intecjiated. Foity L>ul)ji'Cts received the display method 
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which involved vi.sually presenting KubjecU? with the actual 
lines. Another 40 subjectti received the second method, i,he 
iwayery method, which involved visually' piesentiny the 
subjects with three nuibers only and they had to iiuarjine the 
lines corresponding to the numbers. 

The letters in the alphabet were classified into five 
groups by the number of elements needed to form the letters 
(1, 2, or 3 lines needed) and by the type of tiansf ormation 
needed to lorm the letters (change position oi size of the 
lines) . A letter was one-element if a single line could be 
identified as that letter; C, I and U were one-element 
lettVrSj. , 0, ' D, Xt V, T, and L were classified as two- 
element position letters because two lines had to change 
their relative positions in order to construct, the letter. 
To construct size letters, both the size and relation 
positions of the lines had to be transformed • The two-- 
element si?*- letters were J, S, and Y. The three-^element 
size letters were A, K, Q, and R. To review, subjects 
were (jiven 3 lines or 3 nunibers and they had to mentally 
combine the piMceive or imarjined lines in diffe^cent ways to 
construct as many capital letters as they could* As the 
subjects said the letters aloud, the experimenter recorded 
their responses. 



Insert Fiyure 2 about here. 
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Fiyurc 2 shows the mean percentage of letters generated 
for the imagery and display conditions for the U types of 
letters. Subjects who saw the lines and curves generated 
significantly wore letters than the subjects who imagined 
the the lines (51. IX vs. 33.2% respectively, F(1,71)= 23.24, 
£<.05) . ' There was no difference in the number of 
inappropriate letters for the display and imagery groups 
(U.5 letters each) . 

Figure 2 also shows that this difference between the 
perception and imagery groups was consistent over the U 
types of letters. The parallel response pattern was 
statistically supiKjrted by the lack of an interaction 
between type of letter and information source (imagining vs. 
perceiving) (F (3,213) =1.81, p<.05) and suggests that 
subjects in the imagery and display conditions used similar 
cognitive processes to integrated the lines and curves into 
letters. Furthermore, this similarity demonstrated here 
occurred when subjects themselves weie able to select their 
own rules for mentally combining the elements rather than 
being given a specific rule by the experimenter which is 
typical of previous investigations. 

At this point it is imiwrtant to identify a second 
methodological difference between the present and previous 
experiments.. Subjects could use two different global 
strategics to perform the tas)t; they could work forward or 
they could work backward (Newell 6 Simon, 1972). Subjects 
could begin with the three lines and mentally manipulate the 
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different cowbinationK ot lines to generate a letter (the 
goal respontie) , i.e. work forward from lines to letters^ or 
they could begin each trial by mentally going through the 
alphabet (possible goal responses) and evaluate whether a 
letter could be divided into the lines presented # i.e. work 
backward from letter to lines. If subjects work backward^ 
they should consistently report sequences of alphabetically^ 
ordered letters. Working forward shoi^ld not result in a 
high percentage of alphabetic sequences. 

The order in which the subject emitted letters of the 
same type was recorded and the letter sequences were coded 
as beijig either alphabetically or noh-alphabetically 
ordered. The analysis of the percentage of alphabetic and 
nou'-alphahftic two-^letter sequences indicates that the 
display condition generated more alphabetic sequences than 
non-alphabetic sequences iile the imagery condition 
generated Dioie non-alphabetic sequences than alphabetic 
sequpnces* 

This significant interaction between the type of 
response tiequence and the source of the elements (imagined 
vs. perceived) suggests that the display subjects were more 
likely to woik backwards^ while subjects who imagined the 
lines were mMv likely to work forwards. 

To further examine this hypothesis^ we classified 
subjects as woikiny backward if B0% oi more of their two-- 
letter seu\iences were alphabetically ordered. Subjects were 
classified as working forward if less than B0% ot their two- 

er|c 8 
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letter sc^yiiences were alphabetic sequences • Subjects with b 
or fewer two-letter sequences could not be reliably 
classified as using either working forward or backward 
because of the relatively high probability of reporting 
alphabetic two--letter seguences 80% of the time by chance* 



Insert Figure 3 about here. 



Figure 3 shows the mean percentages of each letter-type 
of subjects who imagined and perceived the ligures after 
they were assigned to the alphabetic or non-alphabetic 
groups. Ho ifiiagery subjects were classified as working 
backwards while about a third of the display subjects who 
could be classiiFiedt were identified as working backwards. 
As shown in Figure 3^ the different global strategies 
effected subjects* performances. Subjects working backward 
generated sicjnigican tly more size letters than either the 
display oi imagery subjects who worked forward. 
Furthermore, there were no differences between the 
percentage of one-^el eittent letters, two-element, and three- 
element •->i5:e letters generated by the subjects who worked 
backward . 

When subjects worked forward, whether they saw or 
imagined the lines and curves, they generated significantly 
fewer i5i7e 3etters than one-eleiaent le^ "ers • When working 
forward, jsuJ)jects who imagined the elements and subjects who 
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perceivetl the elements lieiformed the same on letters 
requiring integration. 

Discussio n 

The interestiiuj feature of the present experiment is 
that it showed both siiiilarities and differences in how 
imagined and perceived inforiation is integrated within a 

single task. The parallel response patterns for the inagery 

i 

and display condition shown in Figuie 2 suggests that the 
sane cognitive processes were used to integrate the imagined 
and perci^ived stimuli, with the/ exception that the 
integration of iroaginery figures was in general, less 
succeissful. But we aliso found that the percentage ol 
alphabntic ^eguences was differentially affected by 
Imager y/Pei ception Manipulation. These results suggest that 
displaying the elements created a situation in which 
subjects were mor%> likely to work backward and the working 
backward pioduced a different pattern of letter generations 
than working forward. 

( 

To pel form the task, subjects in the imagery condition 
had to recall the newly learned f igure-nuiaber associations, 
store the images and mentally manipulate the images. If the 
imagery subjects also used an alphabetic strategy, they 
would have to mentally go through the alphabet as well as 
recall, rehearse and manipulate various combinations of 
elements. All of these cognitive demands could result in 
competition for the limited capacity of primary Biemory. 
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There is not an excessive coynitive load when the stiftuli 
are physically stored in the environment, that is when the 
•^^-^rson perceives the lines, because the elements do not have 
to be recalled and rehearsed while manipulatiny the©. The 
display subjects could sequentially evaluate i£ each 
mentally represented letter alphabet could be divided into 
the figures displayed in front of them* The display 
condition made the task-eff ecient alphabetic strategy a 
viable ttrategy while the imagery condition made the 
alphabetic strategy a difficult one to successfully employ. ^ 
In conclusion, the different sources of stimulus 
information can produce different situational and cognitive 
demands. These factors can effect the subject^s choice of 
problem solving strategies and consequently, different 
strategies can produce different response patterns. The 
present study points to the need to develop methods 
illustrate the the similarities and difference in 
imagination and perception by not restrict the strategies 
subjects might U£>e in processing imagined and perceived 
information. r>y veftoving some restrictions, the experiments 
designed may produce results that may be more than self- 
fulfilling piophecies • 
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